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ABSTRACT 


M.jd 1 - low level vision work irk At deals with onp-oimensional intensify profiles. This paper oescriijos 
PROPAR, a system ‘hal a lows a convenient and uniform mechanism ior recognizing sueh profiles. 
PROPAR is a modified Augmented Transition Asfwdrhs parser. The grammar used by the parser serves 
!0 describe and ;abe the sel pF accootadle profile*. Tha input to the parget are descriptions of 
segments of a piecewise linear approximation to m intensity profile. A sampfe grammar is presented 
and tha result? discussed, 
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Institute of Technology, Support I or fne is-Doralory^ artificial intelligence research is provided in part 
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A tfgilMieartt psrt of Ihe At work on Ibw-ievel vision has dealt with the examination of one dimensional 
intensity profiles [1,2,3) 1 will avoid the issue of the suitebiiiiy of (his * pjjr oach to low level vision. 
Rather 1 will take far granted that the an S ly i(S ot intensity profiles along rays or circles On the insist 
is a useful tool in Viji&ftt repertoire Ql techniques. This paper Suggests a mechanism for dealing with 
these profiles m a convenient and somewhat unitorm fashion, 

This paper is an "intellectual descendant" of my previous working paper 13) in the sense that it 
addresses some of the issues that ] "discovered" in the process o! implementing the program 
described tnere. Thus, this is an attempt to solve a problem fhal is not immediately apparent as a 
hard problem, namely classification and segmentation of one dimensional profiles, The prOgr-ras 
•described in [3] attempted to characterize Ihe visual structure of electronic components in terms qf 
tne spatial relationship* bclween several types of fntensily profiles. This hind of charanler^aUon, 
although quite effective, proved to b* cumbersome in terms of the sheer amount and ad-hoc nature Of 
Ihe code needed to embody it. The immediate £Qal of the new system, PR0PA&, is to alleviate these 
problems by presenting a convenient interface to the high level description of intensity profiles. I 

be I eve that the system has some other desirable properties, and ] will bring these up as Ihey become 
evident, 

PfiflPAR is eiSenliatly an Augmented Transition Networks [4] parser (hat has bean modified to deal 
With intensity profile!, The gramme used by the parser serves So describe and label the set of 
acceptable proFile* K a sequence of input ’words" The "words’ that serve as input to the parser 
descriptions Of segments Of a piecewise linear approximation to ihe intensify profile. 

JL ATN GRAMMARS 

Augmented Trans it ion Network grammars are an extension oF Non-C*terministic Fmlt* Slate Grammars. 
The extensions are basically as fellows: 

1) Arc tests; Associated with each state transition arc it one or more test? that determines 
whether that slate transition is to be made. 

2) Are actions: ATN grammes also allow specification Of arbitrary actions to take place 
flnee the arc is taken. This allows ter side elfeets such as the construction of a parse 
tree. All arcs specify wn»t the wt (tale should be and whether to advance (he input. 

The actions TO and JUkfP perform these I asks. 

3) Registers: The primary type □! art action is th* filing of r c sisters whose values can 
be manipulates and tested on the arcs, 

A) Recursion; ATiN also allows special transition ires labelled PUSH whose effect is to save 
!ne current stele, the register contents ana the input pointer. It also transfers control to 
tne it ate specified On the arc without advancing the input, Arcs labelled POP will resume 
the parse a I the place ot the Last PU$K Communication between levels is effected by 
means ql the registers. A SENjR action sete the value of a register wh-Ch is transmitted 
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to the mx! stBle PU$H>atf to. Another are act. LIFT* jerve* f S *t * renter | n the s.1 a1 e 
10 be PCFeo to, A POP »„ al^ Sy5 returns a va | ye which bound , 0 B specii | 
rfrgritfrr celled 


Ar, ATN srompiar eonpiets at a lilt at sl 4 „s.esrh at thsee cnn.isls at , tat at „„ .™ n „ i( « , r(m lw 
Stale. There are types of arts: 

1} CAT; each input word Won** to * cales-ory, this arc it considered If |» B calory oF lh* 
ihpyt matches that specified on the arc. The tergal is ta follows: 
tCAT <ca1egOry> <tg*t> <11 ft OF actions--! 

IF the category Of the input mitthas <c»Feg 0 ry> and <tes1> evaluates to non-NJL the lift 
of oetions specified is 1o be evaluiltd 

2) TST; this typ-® of art allows for arbitrary tests. 
tTST c tast> <hst Of Bc(*Ons>) 

The list of actions it executed rFf <te 5 ^ EVAL’s to nfln-NIL 
3} PUSH: this lype of arc itnptsmenls "subroutine tails" 


{PUSH <s1tt e > <tesl^ OisE of *£(ions>) 

It <1os!> estates to nOn-NiL the PJEH acton is ewtd** upon return the arc actions 

"• * lWl the « bound to Ih* mull of the PUSH arc h i.e. th» 

y siue Of Ihe POP arc. 

4) POP: this typo of arc effects b return from a PUSH 
(POP < value* <1etr>} 

If <te S3 > evaluates to nan-NH the regular « is * Dt to teoe vatus of <v,iue> and elocution 
resumes where laul interrupted by a PUSH. 


The tttrons on tto arts can be arbitrary USP to™ although Shore ere e tow special on, E; 

1) (5£TR <regis1er> <value>) * 9 \ s a renter. 

2) ECETR <regis.t6r>) returns Jhe vsluS OF the fAgisEer. 

3) {SEMDR <rejisler> <vali»»J sett a register j n |h e next state PUSH'Sd to. 

4) fLIFTR <regiEler> <value>) sets a register in the nc«! stale P0P>d io, 

5 > (GEYF <fea 1 ure>) gel Ihe value Of an inpul feature 

6) (TO <s1ate^J indicates thal a transit ion to <itete> Is 1* be made and that the input .* to be 
advanced (ususaliy ihe last action on an arc}. 

7) UlMP <s;ate»; similar to TO but does nol advance th® rnput. 

A„ OKompIo r»,h. elMe of this up The staple |r« w shewn in TIC 1 -.eeepls- two kinds of 

**“ ,D ™ "W V nP " » ^ » ADJ". Th, . is . epee.,, „tfete, whiph rplds the 

input word. The first entry pi e«h of the fp;iow,n 5 j is i, is lw sla ,. lt ,, (o |, awsd b „ 4r 
more arcs. 
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(S {PUSFf ?|p I (SETR SUBJ M) {To gi)>) 
m (TST (EQUAL * 'IS) (TO Q4)J 
(CAT V T (SETR V **} (To Q 2 >j) 

(Q2 £PUScS WP T (SETR OBJ **) (TO QJ}) 

£Q3 {POP {LIST (SETR S'JBJ) (GETR V) (GE7R OBJ)) T)) 
(Q^ (CAT AIiJ T {S£TR AW *) (TO OS>)> 

{Q5 (POP (LIST (GIIR SLBJ) ‘IS (GETR ADJ)) T)j 
(MP (CAT DET T (SETR PET -> {TO Cj&)> 

(TST T (JUMP Q$n> 

(W (CAT N T (SETR N *) (TO Q7}JJ 
(Q7 (POP (LIST {GETI DET) (GETS, N)) T) > 


F]G I: A ianpfa g. r amm?r 
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The parser simulates 1 he nan-determinism of the grammar by following ihe e eg-tie ares- in order of 
their appearance an !he ft*)*. When a stale is reached in which no arcs are elegibie, the parser 
baths yp to the i^S-t point where there is an unexporcd arc which is e'iBgihle. 

The input ■words' used by PRDPAH am segments cl 3 piecewise linear approximation Of the 
intensity profile along * ray On the ima&e. The category *F a Begmant is He steps. CAT arcs have 
therefore been extended so that they not enty t)Q an EQUAL test it Ihe category on the arc is an 
atom, but they can also tesl it it .ies wilhin specified bounds indicated on (he arc by a list pf length 
2. For example! 

CCat ft. 3.) T fSETR up *J (TO DOWN)} 

.he grammar treats the input pointer, i.e, the place and direction from which input is to be taken. 
Specially. Whenever a PUSH arc Is taken, a BENCH ot the inpul pointer i& automatically done. This 
serves to Inform that arc of tne place in the image where the next input i$ to come trorn. A POP 
arc always does a hidden L1FTH of the input painter to inform Ihe higher level ol where the input 
has advanced to, this is necessary because betere doing a PUSH al Ihe register values are saved 
and then restored when the state POP’s. Treating the input as a register allows automatic backup 
df Ihe input to happen when a PUSH tails. Both the hidden SEN DR and LIFTS of the input pointer 
can be superseded by explicit actions provided by the parser, SENDPTR and LSrTFTR. The nature 
Of tne input tunc lion is described in- the nexl section, 

]][. Characterising the Enput 

A large measure of the benefit to be gained from the Synlaclie approach to image analysis stems 
from the structure ,t imposes on the input. The first step in any such system is the isolation oF the 
words tp serve as input. This usually involves segmentation. of the input in either the spatial or 
lime domain, PROPAfl uses as an inpyl domain a piecewise linear approximation to the smoothed 
Intensity. The segments are represented by their slopes quantized into 31 small number of integral 
v*lues-(currently nine}. The «npu! is laken ifom a point and direction specified by the grammar. 

^e input waveform i; smoothed by a hysterisis smoothing function [5], FIG: 2 shows an example. 
The (unction moves along an inpul ray and return* the value of the input iff .( ils magnitude i* 
sufficiently greater |h fln the magnitude OF the last point examined. Otherwise, H returns the value 
Of the previous input point. This function has several distinct advantages, it removes low amplitude 
noise without throwing away the high frequencies as averaging does, takeover, the nature pi its 
effect On the waveform is easily predictable since it returns stretches ol constant intensity 

whenever a variation m the input is below a given threshold determined by the noise level of the 
Input device. 

The input profile is segmented at place* where the slo-pa quantifier! assigned to }ht slopo 
between two points differs from the quantization assigned to the slope between the previous 
points, The Function returns She dope quantization, the coordinates ol the first and Iasi points and 
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■a* The raw datii 


IKT 



b. Sannthed data 


FIG, 1 - HysteriaIs 5monthing 
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Ihft Intensities theft. These can be accessed as failures of the inptnt w&rd by GETF, The features 
iro caMed CAT, PTl, PTZ, [1 and 32 Tespediveiy, F[Q, 3 show* an example of an input prolife. R5 
3a shows the raw intensity data, 3b shows the smoothed intensity, figures 3a and 3b are very 
Sirniiar because the data does nol have many small fluctuations , Figure 3e shows the segmented 
input with the slope quantiratidns. Notice that a significant data compietslon has been achioved, 
while the overall sh&pe remains unchanged. 

Several issues are relevant to the characterisation Of the input, IN* first k ■ Hqw good does the 
charaeterteahOm have te be?' Obviously* this depends on the dr$1inetions the grammar is capable of 
making. In the kind oF processing t h ve done using PROFAR, only the rough shape c! the input was 
of Infer**! a nd thus a very trivial segmentation algorithm was chosen. There are several 
applicaliorE Df profile techniques that depend on accurate measurerrcnls to be taken &n the input 
rather than on the determination of its general form. For such domains this input dweclerf»ll 9 n 
is inadequate. Some examples of such applications are precise edge localibn [1,2] and cardiogram 
anlytk [6,7]. A 1 airly large literature [8,9,10] exists on approximation methods tor waveforms and 
any such Algorithm might be used in conjunction with the system. 


The other and more interesting question i? whether the expectations of the grammar can influence 
the type of processing done on the input- Reference [6] makes a strong and quite valid point that 
umess thrs is done the system: is not truly a syntactic analysis system but rather a dala- 
compresssion algorithm. The reason being that in general syntactic analysis th B segregation pf 
basic units Into constituenSs depends On the slate of the parse as well as on the synlacfic ctess ol 
the basic units. J fhmh the merit* of data compression should nol he belittled, but. i agree with the 
essence Of their Argument. Their solution was to deFin* an input lunetion ter each of the members 
of the sdl Of primitive constituents, e4- a parabola. PROPAR., on the other hind, is based on the 
principle that as much of the input processing should he exploit as possible. The grammar designer 
should hive control of the processing to any desired level of detail. Theoretically the grammar 
should look at the input on a point by poinl b*$i* r Ihn is wofMblt in the ATM gemmae because 
thre PUSH are* a low one to structure Ihe gr**nmar hierarchically. The detail can be added at one 
level without cluttering the grammar at all levels. The only reason ior not gOmg to this extreme 
are efficiency considerations, namely size ol the grammar and speed of execution, 

FRC-PAF? is compatible with two extea-gramma!icat mechanisms for influencing the input process. 
One is to define several USR Funclians that look lor the particular features oF interest as in [SJ 
These functions can be called by a PUSH arc since state? are Irealed uniformly as program* that 
are caded with the current contents of the registers as argument. Another is lo change the Input 
function »* the mead arises. The input fu^ctron used it determined by the value «f a register end rs 
thus under cdntrol of the gramm&t. it is important 10 remember that improving the quality of the 
representation is only useful when the grammar can nuke use *F the improvement. So far [ have 
found tbo uniform representation both adequate end etFicient. 
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FIG, J- Input processing, example. 
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[V, A Sample Grammar 

'-Vhat fellows is a grammar (hat atlempls it incorpcrplB the basic features at prplilns OF cylindrical 
objects with one hi g h|i t M, namely thal the infancy decreases towards the edges of the object. 
The Cvj_ grammar Is shown on F)S 4. This grammar is Suilt up out of PUSKes to other networks 
taiso shown on FJG 4), STEP*, STEP- and HOLE The STEP* network success if the input slope is 
positive and of sufficient length it also advances the input ppinler 1o the nont local maNimyin in the 
profile. ST^P- oops tho same thing For negate slopes and HOLE accepts a STEP- followed by a 
STEP+. These networks wi|[ be discussed later. 


(CYL (T£T T (SETH STMT (GETF PH)} [JUMP CYL-UP))) ' 

[ CYL-UP (PUSH HCtLE T (5ETK UP “) (JUHP CTL-POHN)}' 

< PUSH STEP+ T (SLTR UP **} (JUHP CYL-DOWIJJi) 

(CYL-DOWN (PUSH HOLE T (SE7R DOUM *>) (JUMP CYL1)) 

{PUSH STEP- T (SETR HUM **) (JUMP CYL!))) 

(CYU! {POP (LIST h CYL (GE7A START) (GETF PT1) (GETR UP) {CETR DOWN)) T)) 

state CYL joit sets the register START to the value of the first point of (ho current input CYL-UP 
sets the register UP either to the value returned, fay a celt to HQLE or to STEP*. CYi-MWN does 
the same for register DOWN except that the second choice is STEP- CYLt just return* a list built 
by the POP arc which contains the beginning and end points of the proFile as well as the values 
returnee by the HOtE Or STEP* and STEP- networks. A RUSK to the state CYL can cause one of 
two things to haopen a) the grammar fails to accept the input, meaning that the current input 
segment does nol begin a legal CYL profife, or b} a CYL profile is returned. This very simple 
grammar accepts intensity profiles belonging to one of th s tour classes shown in F]G £ On the newt 
page. FIG 6- shows the results oF the grammar on a typical proFile, 

A useful extension Of this grammar would be a way to exarwne i spue Hied length of the input 

sequentially until a CYL profile was found. These three states do precisely that tor the CYL 
grammar. 

(FINU-CYL (PUSH CVL T (SETH CYL **) fJUFIP FOUND-CYL)) 

(TST T {SITE. STATE ’FIND-CTL) {TO SEARCH))} 

(SEARCH (TST (.NOT (BEYOND {QETF PT2) (GcTR END-SEARCH))) 

(JUMP (GETR STATE)>)> 

(FDUND-CYL (POP {&Z.TR CVL) T)) 

FENCh-CYL does a PUSH to CYL and if ft suceedt just returns it. If the PUSH fails then the register 
STATE is sc! lo the state 1o go tp if I he point where 1h* search is fo end (END-SEARCH) has not 
been ^exceeded. SEARCH checks !h*t the input it wilhin the desired boundary and then either 
JUKAPs to the Stale specified by the register STATE or falls. 
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d. 3-TEP+ STEP- 


FIG 5, - Fipur kinds of CYL profiles 
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FIG, 6 - Segmented input and Parsing 
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What fol-ows is Ihe ETEP+ network. The method embodied in Ihis network, is very erode but il will 
do far our purposes. Ln more demanding. appiicatio^a, irqre elaboration r* needed, For instance, 
thta network ignOros the actual valut of (he slope, ]f one warded Ip locale the edges with any 
degree Df accuracy Ihe grammar and possibly 1h& input Function would have la be changed, ]n the 
cruMPip cs shown in the appendix One can notice lhat the position OF Ihe edges is not very accurate. 
I Find i! somewhat surprising that this simple network works at all. 

(5-TEP+ (TST T [5ET1 START [QETF PT1J) (JUFtP UPt))) 

(UM (CAT (I. 4,) T 

(SETR P [HERjfiE (&ETR T) *)) 

(5ETR TIR+ l GETF rTZJ> 

(TO UP')) 

(CAT t)„ (LE3SP (&ETF RUN) SIOTHA) 

(SETR P (MERGE (EETR P) ■))) 

(TO UP!)} 

(PSP (LIST ‘STEP+ (flETR START) (QETF PT1) (GETR R)) ■ 

(AtJp (GE7R TIP*) (GHEATERP (CADDR. [GEIR R)) SIGTFtR)))) 

Slate UP! accepts Sequences at segments whose quantized slope is greater thart 0 and segmenls of 
tlope equal to 0 whose ar;th exceeds SIGTHR, Hogifiler P will be a list of the form (SLOPE R]£E 
HLH). .he run is the iength Of the sequence, Ihe rise >S the intensity change along the sequence 
and the slope is lha quantization belching to the quotient of Ihe rise and the run. The function 
ACS3E conslrucii a new value of P trOm Fhe old value and the input. Register HP* contains (he 
local maxima of the prOFile so tar. The network for STEP- exactly parallel* that tor 5T.EF+ and the 
MOLE network just consists of a PUSH to STEP- Followed by a PUSH to STEP+. 

It shouid be fajriy clear Shat this grammar is quite general, it has, in fact, boon used sueeesfulty To 
analyze two very different scenes. One Of a hammer handle and (h? ether Of resistors, Thu 
appendix describes these application*, 

V, Extensions 

. he system as -described so far Fulfills ils origina. goal of providing a convenient descripjive 
iMKhfclwm far one CimenEiOnal prolilt*. After the research reported here bad been carried oul, a 
similar effort [6*7] was pointed oul to im. These excellent papers describe a system very similar 
in style to PROPAR applied Ip the parsing of £KG wavetormc. This system focused On several very 
important issues which ( had neglected, namely interaction Of Ihe parting process with the input 
process and non IcFMo-righl parsing. Their choice ot grammar (extended EfVF) forced them to 
introduce extra-grammatical mechanisms 1o deal with these extensions, t think it indicative of a 
right choke qF grammar tor PROPAR thal both these mechanisms could no incorporated explicitly In 
the grammar just as the oxtens on to two dimensions tan also be made explicit. This section deal* 
with these three extensions and their embodiment in PRCPAR 
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A. TTib Other disnunsipn 

B«1 in.«.. nr. two cjin.w.ion.1 end th. key to 1h e i, .Iructd,,, an so! do„ « „|, ckB d htm IN. 
’"“IT »™lile S . Proli*. , lona , , ay „„ , ypicj|l¥ a „ tituogs „ , s hjrd 

10 Mh.root.rt. ™„,„ efess bympc Iron, In. .ijoiltanl lento,» s . The prinnip.1 Co. to cijnlficnre 
.0 coherence in two d.mnnnon,. PHOPm .J>pr«ch„ IN. by ™ ln5 o, . .imp,. 0 ,™,, 

sev.,,1 prol.lec. Once . pnrtlalnr type of prolife Or one. recojtniad, the grnrwnnr r,n one Ihe 
dncriplnn returned to surest where to look to, other proiilss ,1 known | y „ s . This eereec to 
cher net prize two dimension,! profiles. The simplest lorn, ol this techoiqoe is os.ne the s.m. 
gram-nor atom perellel rays. 1„ this form PROPAR beheve, like , jeneclrzed lecher such « he. 
been used in lino hndnrs (1J This ertensien to the CVL ... c.rr.eo out ,„d ,fe. respite 

ere described 10 Append,. 1. The obvious nert step I, proljles along non-parellel rays end this is 
also demonslraleel m Appendix L 

0c frion Jeff-to-nghf parsing 

lr wa^Jorrns such as inlensity profiles, speech signal* or EK<^ where noise is prevalent, th* 
commitment 3 d left to n 0 h( parsing S’gnrFkantty inches the probabiljly pi failyre. Several people 

'" iS fflCt Whal ° ne mieh[ Wirt| i5 tQ «"* dgnlfi™* feature, f.rst 

and then IPDk harder, or at least d.ffereniiy, rn Hi* canlerFs defied hy these features for other 

oaLures deseed relationships, This is not as obscure as if sound*, especially in one 

dimension. FRQPAR afready has al.i ihe right ^chani,™ nee^d for thit Let us oppose we 
wanted Id pulf out of a scene the flat area between iwo CYL profile* that might he Vflry c |„, 

!° S f ^ be thc bMfcJ r ^ an ******* two resistors). Thtj might be very easy to miss 
C * U ^ oi 1hff cjruosrie5i at Ihs state* UP; and D3WML L.1 us peculate a stale FLAT! which 
rT* 3 Pf the P ^ f,le in a ^ stjal w ‘¥ -nef determines whether il is flat AN wc need lo 

! 15 Wh0re t0 STAHT b ¥ sendi ^ ■' 'he v*|ue ^ I** tNPLTT^TR al the end of th* first CYL 
pro ue and where 1c END, namely the beginning OF Fhe second CYL proFile i*, (CADR ■ ■). 

(CYU (PUSH FlND-CYL T fSETFt START fGETR INPliT-PTRJ) (JUMP CYLZ})} 

(CYU {PUSH FIWD-CYL T (SENDR END (CMft **) J 

(S £WDP ’R (GETR START) KJUtl? FLAT))) 

(FLAT (PUSH FLATT T (SETR FLAT "*} (JUPtP BACK.)) 1 
{BACK (POP {GEIR FLAT) T)) 

™‘J‘ ‘ * , ?Y I ™' hanlS “ — 1 b,ii ‘™ * » 1- bcprable th,t .uch ™eb.ni.m, b. 

under ekplicit enntro, qF (no grammar designer. 

VI, Conclusions . 

tn Ihi. ..ctlon ]’d tlk. Id .tap b.A end .oh s j obsl , u . tlio „, Jb0u , th , w , rt ;t , 
irnpucalipris, Tne following issues item irrpprjanti 
A. The choice oF the methodf Why parsing? 
a Tne Choice of (he toolsr Why an ATK parser? 
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C. The limitations of the rnalhod. 

Let us. examine these m turn, 

A. The choice of the method 

p arsirg it a useful approach 1u I he representation of one dimensional pattern* because of alC [he 
w ong reasons. Its usefulness slems Irom Ihe ability to unccily legal subsequences in the gram mar 
end essentially Ignore all tne comoinalorics of the interactions by relegating them to the uniform 
workings Of a parsing algorithm. This, at course, makes al the ergunvenls relevant 10 the choice 
between LC-^IC, PLANNER and CONMfVER [12] relevant to Iho decision of using oarsing as a method. 
I think the progr-Kriftn from Tr informational Grammar* So ATTC and PRO&RAMMAH to M.reus's 
WAS P .13] ref.nets a conce-'n with [he Eame issues: mainly the inefficiencies Of uniform strategics. 
On the other hand, the atfractivsnes Of uniformity Of (he PLANNER and ATN variety for limited 
domains cannot be disputed., One can only ma*e use of more cemlrOl over processes when dho 
knowt more about diaEfOsia of She interactions; in our case thal knowledge it missing and the 
convenience cF writing simple grammars is worth the prut* ot some extra combinatorics. 

B. The choice ot Ihe tools 

Grice we have settled on parsing as an approach to Ihe problem, the Question remains of which 
type Of grammar rs adequate. Adequacy hat two dimension*, sufficiency and necessity. The 
sufficiency need not be argued with respect to the choice of ATN a; a 1001 except as regards Ihe 
■matter of uniform control structure. ] believe that, at least For limited applications, the ease of 
represent at.-on it wO-rtfa the price Oms pays in host Of direct control, I have IP qualify that claim 
enough Ed include the possibility thal Ihe control structure prevent* the solution Of the problem, If 
(he size o1 the class of acceptable profiles gr*ws very large thie lalter might be the case. The 
limited number of examples I’ve currently tried lend to sugeisst that this is not th B case of the use* 
the Syttem was designed tor, namely as a flexible verification system. It is possible,, although this 
merit* another- paper, to design the grammars, to reduce the amount of unguided backup thal needs 
to be dona, something which Woods seldom tried to do in his English grammar. The Feet that tha 
Wood=‘ LUNAR sy*tem was feasihle even wilh no considerations of guided backup seem* to me to 
suggest cuite strongly [hat the cootroi slrudure problem will he minor at the level PfiQPAP .is 
meant lo operate. I don't believe that th* kind of analysis PRDPAR docs On one dimensional 
intensity profiles is more complex than the cnglish domain of LUNAS. General two dimensional 
analysis can be quite explosive, except that FR3PAR, by relying on two dimensional coherence, 
effectively decouple* most Of the interactions between dimensions. This fact is a source of One Of 
the major limitation* of lha system but, On the other hand, it reduce* the complexity of the problem 
to approximately the complexity of [he one dimensional problem since For any given prof Me in bra 
dimension only a smalt number of profiles can be coherent with it in fhc Other dimension, givon 
reasonable smoothness assumptions. 

Another imoOrtant theoretical issue is the necessity aspect of adequacy. We would like Ihe 
simplest system that the data force* us So accept- 3 Ihink ATM grammars ere ju*Gf, e d in these 
terms given a measure ot simplicity that is not just th* number of lines Of code. I believe that the 
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Of use be weighted qui it heavily, insofar as this is 3 r experimental system ease ot 

mOoiliceFiQri and unde-re I and ng are crucial. Since the p'ob sn t? not solved, generalily re important. 
Orte would rsHher the solution is f&und before the inherent limitations OF the system were reached. 
As an exan-pie of the case in print let us consider the "need - for recursion. I htltevp that the 
description of some intensity profiles it most economically captured by e recursive grammar, e.g a 
bump on a bump On a bump ,_, Appendix 2 presents a mote elaborate version of the STEP+ 
grammar which is recursive, ft does not prove Ihet recursion is required but I believe it suggests 
its convenience. On the other hand, there is an independently motivated reason for having 
subroutine cells, namely clarity aruJ economy of specification. Once have subroutine calls why 
hot altow them to be recursive? The same |rne Of argument tOhows For registers. 

Considerations of efficiency always color our pudgmenls Of even experimental systems, 50 a word 
about it might be ttflcd For. FRQP.AR is a Fairly modest size MACLC&P program, compared to Ihe 
typical Al MACLISP program. The system allows for compilation of Ihe grammar into LISP programs 
that are then compilable. In this mode Ihe system is reasonably IkI, again compared td other USP 
programs, and is moslly bounded by data access speed. 

C. The limitations ol the method 

The major limitation of the use of the system is its dependence 00 "axes". The problem stems Irom 
The view ot grammars xs a passrve tep-'csenletion of the legal sequences! remember that the 
automata Implementing most lypes of grammars are known an accepters, lb* most straightforward. 
Ergo useful, way of writing a profile grammar is to encode the profile obtained by scanning the 
object from a given- direction, usually along. the line 0-t steepest slope. For most profiles this is 
quite sensitive Id the direction of view, i,a the relalionship between [he input ray tod the profile. 
It hs thus fairly clear that these gram-mars wet** best as verifiers rather than as proposers. It is in 
this guise I hat PRQPAR was used in the two examples discussed in Ihe Appendix:. I believe th* 
system In This Form to be qurte uselul *s 9 tool for a more intelligent syslem such as Freudsr's 
SEER [1AJ. 

The tyitem has no inherent limitation;, that Force it to be passive. The extensions to nen-fefMci- 
right end two dimensional parsing demons I rate this. The problem n^w becomes one of designing 
the right aclive grammars that decide from a given profile, not only whether i| is one Ot the known 
views OF a profile but, but diO what action; snould be taken otherwise. For Instance, if the desired 
nrolile is not found, the grammar might try several scan; along dilferent angles from the starling 
point. With the CYL gtamnar this would 1 help find profiles when the original scan was nearly 
paralle’ to fto axis of the profile {the f*n E lh gj the cylinder^ I think that PRQPAR might be Ihe righl 
environment fri the development and coding of such procedures. [ t*rft rule out the possibility 
that the inherent limitations of the dw dimensional approach force e failure be Fore [hen. 
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Appendix I; Result* 

This appendix descries so™ applications gf the CYL grammar as pressed in the body of th c 
paper, in the f.rst e^nple the gra™, r was used to varjly a hypothesis gelled by the SEER 
L iflj sysiem. The scene Under consideration, consisting of a hammer On * workbench, is shown on 
Ihe ne^t Page {figure AU the sc«n fines snow woer* CYL profile were found, PROPAR was used 
to track the hammer handle tp completion, SEER hypaH*,i«d * s |artta( point and a search 
direction and Ihen called PRCPAF? *1 state FfND-CYL The Mine poinl sod direction are shown on 
the P'Clure and the parallel scans used by She system. There are several things lo nOl.ce about 
ihe remits, Near the end Of the handle notice that the scans change direction. This is done by the 
tracking grammar, onto the sc** (ailed to produce a n B w CVL proFile a iin* was fit lo the points 
found so far, This line was SuMiciently different From the lir* PR3PAR had been following that it 
worried trying again in the new direction. This proved to be the e*fl as *h» handle was then 
1 racked to completion. This technique is usefut for tracemg objects lhal arc supposed to be linear 
Another point to notice is that the profiles along ihe handle (shown p n figure At) are quite 
different, Tne grammar w as allowed to accept any profile that wa s of the right type without 
cneeking further. Jn the next example, the verification of resistors, this decision was reversed and 
1 he grammar compared the suceeding parallel proves for iimilarily. &5th these strategies are 
easily expressed irt the system, Agaip, notice (hat the encooints of the prOFiles do noi correspond 
very wb?I to the edge* of Ihe handle, in som* OF ihe profiles notice that the small STEP- profiles 

° n thB &lde 0f1he P eak a '* ««»* ttea happens because the grammar was set to Ignore very 
Short profiles, The parser retina a desertion of wha l it does find, Lo. the lists returned by the 
PO. arcs, and Ems information can be used Jeter to determine where to look if more dclail was 


T^e second application is to resistors. Figure A3 shows the result ot using the CYL grammar to 
verify a resislor. Cnee |h. parallel .cans are completed and the endpoints of the resistors are 
known, a scan .perpendicular Ed the previous scan* is IsKen so as to pinpoint the bands Figure A4 
snows the m^n,^ profile along the length of fh e resistor. This other grammar consists Of a few 
states that essentially jut Pll $H to the state PEAK (a 5TEP+ followed by a STEP-L One also wants 

to use the scan lhal fine the banc* to identity ihe end, &F the re 5!fi lo r . Since the end, can either 
be illunar-ated or ?n shadow one need* a Few e xUa s t a t eSr 
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FIG. A3.a - Vertical pToilU traces 
Resistot Example 



FI-& A3 .b - Raw intensity profiles 
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Apjaerrdix Z: A More complex STEP* grammar 

i nis appendix s-ho*? an ax arc-pie of a recursive gramma* j this is the slop towards a really 
adequate STEP* gram-nar. 


(STEP+ (1ST T (SETR START (GETF PTI)) (JUMP UP 3))) 

(UP! (CAT (1, 4, ) 

T 

(SETR P (MERGE (GETR P) *)) 

(SETR TIP+ (GETF PT2}) 

(TO UP!)) 

(TST (NOT (CAT (1. 4 t ) *)) {JURf RESUME-5TEP+)) 

[CAT (1, 4.) 

T 

(SETR P (rSERGE (GETR ?) *)) 

(S£T1 TIP* (GETF PT2)) 

(TO STEP+! }) 

(TST T (JUMP STEP*!))) 

(STEP+t (PDP (LIST 'STEP* (GETR START) (GETF PTI) (SETR P)) 

(AND (GETR TIP+) (GREATER? (CADCR (GETR P)) SIGTEiR}))) 

(RE$UnE-5TEP+ (CAT (-2, D.) 

(LES5P (DISTANCE (OR (GETR TIP*) (G£TA START)) 
(GETF PTZ)) 

FLATIttR) 

(OR (GETR TIP+) (SETR START (GETF PTZ))) 

(TO RESUME-5TEP+)) 

(PL'SH UP! 

(AND (CAT £1. 4,) *) (SENDR START (GETR START))) 
(SETR F (MERGE (GETR P) »*)) 

(SETR TIP+ (GETF PTI)) 

(JUMP STEP*!))) 
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basic idea OF this- grammar it to allow s.ma|l intirruplions in a STEP+ prcNIa. Tha STtP+ 
gramrna; r in E hg- body OF I he paper allowed stretches of slops 0 whose length whs smaller then 
SloTHR in the STL 3 + prolile. This grammar evlends that by allowing sequences of Input words 
whose CiAT is 0, -1 or -2 and whose length is smaller tftsn FLATTHP. It also checks to see if fk^ 
STZP+ profile continues beyona the turning point. The issue ts lha! in the earlier STEP* network 
even a very Smal segment of slight negalive slope would step the profits. If the grammar made 
provisions tor accepting these segments. It might have been the case that they belonged to a 
complete STEP- profile. Whal the new grammar does is allow itseli the luxury oF allowing lairiy 
large (FLATTHH > S1GTHR} deviations from pOsilive slope in a $T;P+ profile without commitment to 
accepting it. Tne grammar looks ahead to see if the positive slope is resumed further on and if it 
isn't it returns the piolile Found so far. 

Th* first arc of the state U- = E is identical to that in ’hp p^evio.i gfSmmsr. tl accepts input words 
whose category (slope qu^nlizalien) e, greater than 0, The next arc goes jo slate RESUME-STEP* in 
case the np-ji slope rs iess tnan or ecus 1o 0. The next two ares are the end conditions on the 
recursion,. the "hird arc ends tne recursion at t^al level it the last Input has positive slope and thi 
Iasi arc ends It for al! Olhers. State RESU^E-STEP* accepts input words with negative slope as 
long be their combined iengths do net exceec, FLATTY, Notice JhaE Shis grammar, just as the 
previnu? one, allows a STEP* prcli c to begin with a non-positive slope. This possibility introduces 
an added cons:d*ration. We aonl want 1o a tow 5TEP+ profiles whose positive slops length is less 
than EiGTHR. This chock is performed as the pretest in the p-Op arc of state STEP+1, esrccpl that it 
Chocks the distance trom START 1o the beginning of the current input. If Ihe proMe started with a 
ndn-pOsitive Segment Of length greater than 5IG7HR then o«r desires would have been thwarted. 
The arc act (OR (GETR TIP+) (SETH. START (OETF PTZ))) in the lirst arc of RESUME-STEP+ 
cheehi for this possibility, i.e. the register T(P- would only be set it an input dF positive slope had 
been found, Otherwise 3he register START would be updated to the end of the current input which 
we knew to be ron-posiliva. The seeend *rc OF this stale is taken when a positive Hope it 
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dBtecleti and if proct^tk io ch«k il the slope continues for , length greater than £!GTHR by doin £ 
a PUSH lo UP! and sending it Ihe current value of START. 

Tna rebuffs of wl* thre g rammer On Ihe hammer handl* picture , rt sh6wP1 in (i&ure A5 _ Tbc 
alerting point and sJOpe wer« again fowl by SEER. Notice that although the sons slid do not 
pinpoint She edges s racily Huy lend to cover more oF actual profile. Jd,ny more of the scans 
found She small $7£P- transitions bn In* sides of the hands. The fact that the scans are wider 
than tF>e actual handle are not to be taken as failles oF the system but are to be titled trQm 
the grammar. The grammar we have been using are meant to find the area Of the scene where the 
general pattern Of profile shapes one wants ar c found without pinpointing the edge, tf one used a 
pbint m the STEP* profile where the intensify reaches 70s Or BOS pf ihe nuimum One would have 
* better :cea bt exactly where the edges are 
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